a variational approach to niche construction

In evolutionary biology, niche construction is sometimes described as a genuine evolutionary process whereby organisms, through their activities and regulatory mechanisms, modify their environment such as to steer their own evolutionary trajectory, and that of other species. There is ongoing debate, however, on the extent to which niche construction ought to be considered a bona fide evolutionary force, on a par with natural selection. Recent formulations of the variational free-energy principle as applied to the life sciences describe the properties of living systems, and their selection in evolution, in terms of variational inference. We argue that niche construction can be described using a variational approach. We propose new arguments to support the niche construction perspective, and to extend the variational approach to niche construction to current perspectives in various scientific fields

Game of Thrones: Fully Distributed Learning for Multi-Player Bandits

We consider a multi-armed bandit game where N players compete for M arms for T turns. Each player has different expected rewards for the arms, and the instantaneous rewards are independent and identically distributed or Markovian. When two or more players choose the same arm, they all receive zero reward. Performance is measured using the expected sum of regrets, compared to optimal assignment of arms to players. We assume that each player only knows her actions and the reward she received each turn. Players cannot observe the actions of other players, and no communication between players is possible. We present a distributed algorithm and prove that it achieves an expected sum of regrets of near-O\left(\log T\right). This is the first algorithm to achieve a near order optimal regret in this fully distributed scenario. All other works have assumed that either all players have the same vector of expected rewards or that communication between players is possible.Comment: A preliminary version was accepted to NIPS 2018. This extended paper, currently under review (submitted in September 2019), improves the regret bound to near-log(T), generalizes to unbounded and Markovian rewards and has a much better convergence rat

A Multi-scale View of the Emergent Complexity of Life: A Free-energy Proposal

We review some of the main implications of the free-energy principle (FEP) for the study of the self-organization of living systems – and how the FEP can help us to understand (and model) biotic self-organization across the many temporal and spatial scales over which life exists. In order to maintain its integrity as a bounded system, any biological system - from single cells to complex organisms and societies - has to limit the disorder or dispersion (i.e., the long-run entropy) of its constituent states. We review how this can be achieved by living systems that minimize their variational free energy. Variational free energy is an information theoretic construct, originally introduced into theoretical neuroscience and biology to explain perception, action, and learning. It has since been extended to explain the evolution, development, form, and function of entire organisms, providing a principled model of biotic self-organization and autopoiesis. It has provided insights into biological systems across spatiotemporal scales, ranging from microscales (e.g., sub- and multicellular dynamics), to intermediate scales (e.g., groups of interacting animals and culture), through to macroscale phenomena (the evolution of entire species). A crucial corollary of the FEP is that an organism just is (i.e., embodies or entails) an implicit model of its environment. As such, organisms come to embody causal relationships of their ecological niche, which, in turn, is influenced by their resulting behaviors. Crucially, free-energy minimization can be shown to be equivalent to the maximization of Bayesian model evidence. This allows us to cast natural selection in terms of Bayesian model selection, providing a robust theoretical account of how organisms come to match or accommodate the spatiotemporal complexity of their surrounding niche. In line with the theme of this volume; namely, biological complexity and self-organization, this chapter will examine a variational approach to self-organization across multiple dynamical scales

Lifeworlds in pain: A principled method for investigation and intervention

The experience of pain spans biological, psychological and sociocultural realms, both basic and complex, it is by turns necessary and devastating. Despite an extensive knowledge of the constituents of pain, the ability to translate this into effective intervention remains limited. It is suggested that current, multiscale, medical approaches, largely informed by the biopsychosocial (BPS) model, attempt to integrate knowledge but are undermined by an epistemological obligation, one that necessitates a prior isolation of the constituent parts. To overcome this impasse, we propose that an anthropological stance needs to be taken, underpinned by a Bayesian apparatus situated in computational psychiatry. Here, pain is presented within the context of lifeworlds, where attention is shifted away from the constituents of experience (e.g. nociception, reward processing and fear-avoidance), towards the dynamic affiliation that occurs between these processes over time. We argue that one can derive a principled method of investigation and intervention for pain from modelling approaches in computational psychiatry. We suggest that these modelling methods provide the necessary apparatus to navigate multiscale ontology and epistemology of pain. Finally, a unified approach to the experience of pain is presented, where the relational, inter-subjective phenomenology of pain is brought into contact with a principled method of translation; in so doing, revealing the conditions and possibilities of lifeworlds in pain

Integrating Evolutionary, Cultural, and Computational Psychiatry: A Multilevel Systemic Approach

This paper proposes an integrative perspective on evolutionary, cultural and computational approaches to psychiatry. These three approaches attempt to frame mental disorders as multiscale entities and offer modes of explanations and modeling strategies that can inform clinical practice. Although each of these perspectives involves systemic thinking, each is limited in its ability to address the complex developmental trajectories and larger social systemic interactions that lead to mental disorders. Inspired by computational modeling in theoretical biology, this paper aims to integrate the modes of explanation offered by evolutionary, cultural and computational psychiatry in a multilevel systemic perspective. We apply the resulting Evolutionary, Cultural and Computational (ECC) model to Major Depressive Disorder (MDD) to illustrate how this integrative approach can guide research and practice in psychiatry

Markov blankets and the preformationist assumption

Bruineberg and colleagues argue that a realist interpretation of Markov blankets inadvertently relies upon unfounded assumptions. However, insofar as their diagnosis is accurate, their prescribed instrumentalism may ultimately prove insufficient as a complete remedy. Drawing upon a process-based perspective on living systems, we suggest a potential way to avoid some of the assumptions behind problems described by Bruineberg and colleagues

Multiscale Integration: Beyond Internalism and Externalism

We present a multiscale integrationist interpretation on the boundaries of cognitive systems, using the Markov blanket formalism of the variational free energy principle (FEP). This interpretation is intended as a corrective for the philosophical debate over internalist and externalist interpretations of cognitive boundaries; we stake out a compromise position. We first survey key principles of new radical (extended, enactive, embodied) views of cognition. We then describe an internalist interpretation premised on the Markov blanket formalism. Having reviewed these accounts, we develop our positive multiscale account. We argue that the statistical seclusion of internal from external states of the system – entailed by the existence of a Markov boundary – can coexist happily with the multiscale integration of the system through its dynamics. Our approach does not privilege any given boundary (whether it be that of the brain, body, or world), nor does it argue that all boundaries are equally prescient. We argue that the relevant boundaries of cognition depend on the level being characterised and the explanatory interests that guide investigation. We approach the issue of how and where to draw the boundaries of cognitive systems through a multiscale ontology of cognitive systems, which offers a multidisciplinary research heuristic for cognitive science